Skip to content

Pull requests: vllm-project/vllm

New pull request New
262 Open 1,809 Closed
262 Open 1,809 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Frontend] Customizable RoPE theta
#5197 opened Jun 2, 2024 by sasha0552 Loading…
[Misc] Improve error message when LoRA parsing fails
#5194 opened Jun 2, 2024 by DarkLight1337 Loading…
2
[Core] Support loading GGUF model
#5191 opened Jun 2, 2024 by Isotr0py • Draft
1 of 4 tasks
1
[Model] Add PaliGemma
#5189 opened Jun 2, 2024 by ywang96 • Draft
1
[Core][Prefix Caching] Fix hashing logic for non-full blocks
#5188 opened Jun 2, 2024 by zhuohan123 Loading…
[Bugfix] [Frontend] vLLM api_server.py when using with prompt_token_ids causes error.
#5187 opened Jun 1, 2024 by TikZSZ Loading…
1
[Kernel] Switch fp8 layers to use the CUTLASS kernels
#5183 opened Jun 1, 2024 by tlrmchlsmth • Draft
13
[Model] LoRA support added for command-r
#5178 opened Jun 1, 2024 by sergey-tinkoff Loading…
1
draft2
#5175 opened Jun 1, 2024 by khluu • Draft
bug fixed: cuda out of memory lead to 'AsyncEngineDeadError: Background loop has errored already.
#5173 opened Jun 1, 2024 by charent Loading…
2
2
[Bugfix] Fix illegal memory access for lora
#5169 opened May 31, 2024 by sfc-gh-zhwang • Draft
1
1
[Bugfix] Fix KeyError: 1 When Using LoRA adapters
#5164 opened May 31, 2024 by BlackBird-Coding Loading…
1
1
[Kernel] Pass a device pointer into the quantize kernel for the scales
#5159 opened May 31, 2024 by tlrmchlsmth Loading…
4
[Core] Optimize gpu_memory_utilization parameter to be applied on the GPU memory available after peak_memory
#5158 opened May 31, 2024 by alexm-neuralmagic Loading…
11
[Kernel] Add GPU architecture guards to the CUTLASS w8a8 kernels to reduce binary size
#5157 opened May 31, 2024 by tlrmchlsmth • Draft
2
[KERNEL] int8 quantization kernel refactoring & optimization WIP
#5146 opened May 31, 2024 by ZelboK Loading…
6
add gptq_marlin test for bug report https://github.com/vllm-project/vllm/issues/5088
#5145 opened May 30, 2024 by alexm-neuralmagic Loading…
[Bugfix] Fix KV head calculation for MPT models when using GQA
#5142 opened May 30, 2024 by bfontain Loading…
1
[CI/Build] Test buildkite monorepo plugin
#5140 opened May 30, 2024 by dgoupil Loading…
1
5
[Core] Remove unnecessary copies in flash attn backend
#5138 opened May 30, 2024 by Yard1 Loading…
2
[Feature][Frontend]: Add support for stream_options in ChatCompletionRequest
#5135 opened May 30, 2024 by Etelis Loading…
1
3
[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier
#5131 opened May 30, 2024 by sroy745 Loading…
1
[Misc] Simplify code and fix type annotations in conftest.py
#5118 opened May 30, 2024 by DarkLight1337 Loading…
@rkooo567
1
[Kernel] Add w4a16 support for compressed_tensors models
#5116 opened May 30, 2024 by dsikka Loading…
3
New CI template on AWS stack
#5110 opened May 29, 2024 by khluu Loading…
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.